Stochastic Games.

Introduction.-In a stochastic game the play proceeds by steps from position to position, according to transition probabilities controlled jointly by the two players. We shall assume a finite number, N, of positions, and finite numbers Mk, nk of choices at each position; nevertheless, the game may not be bounded in length. If, when at position k, the players choose their ith and jth alternatives, respectively, then with probability